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@ Multipoir>t teleconference system employing communication channels set in rirtg configuration. 

@ A multipoint teleconference system dispensing FIG 1 

with an MCU, in which terminals (l, 2. 3 and 4 in 
Fig. 1) are connected into a loop configuration 
through an ISDN in such a way thai each terminal is 
coupled with each of the adjacent terminals by a 
single B channel. Thus, a communication frame is 
revolved through a looped communication channel. 
Each terminal renews video data which is contained 
in an allotted area within the received communica- 
tion frame and which was transmitted by the terminal 
itself, and it relays the resulting communication 
frame to the next terminal. 




a. 

Ui 



Rank Xerox {UKl Business 3erv«»s 



1 



EP 0 523 626 A1 



2 



BACKGROUND OF THE INVENTION 

1. Field Of the invention 

The present invention relates to a 
teleconference/telephone terminal. More particular- 
ly, it relates to a multipoint teleconference system 
wherein a conversation or a conference is had by 
connecting leieconference/teiephone terminals at 
three or more multiple points or spots. 

2. Description of the Related Art 

As a multipoint teteconference system in the 
prior art, there has been known one proposed in 
the CCITT (International Telegraph and Telephone 
Consultative Committee) Recommendation H. 320. 

in order to reaiize a multipoint teleconference, 
the multipoint teleconference system is equipped 
with an MCU in addition to 
teleconference/telephone terminals (herein below, 
simply termed "ends"). Herein, the multipoint 
teleconference is lield in such a way that all the 
ends to attend this teleconference are connected 
with the fvlCU, and that the MCU controls commu- 
nications among multiple points. 

Since the prior-art multipoint teleconference 
system realizes the multipoint teleconference as 
stated above, it poses the following problems: 

(1 ) The number of ends which can attend the 
multipoint teleconference, and the transmission 
speed of the communications are limited by the 
admitting capacity of the MCU. 

(2) Even in the state in which all the ends of the 
pertinent group can attend the multipoint 
teleconference, this teleconference cannot be 
held when the MCU is not operating or when all '■ 
available MCU's are busy or occupied for the 
multipoint teleconferences of other groups. 

(3) In a case where the MCU lies at a point 
distant from the ends which attend the mul- 
tipoint teleconference, the communications be- 
come expensive. 

SUMMARY OF THE INVENTION 

The present invention therefore has for its ob- 
ject to provide a multipoint teleconference system 
in which a multipoint teleconference can be re- 
alized by only the ends attending this telecon- 
ference, without requiring any MCU. 

The present invention consists of a multipoint 
video telephone/teleconference system having a 
plurality of video telephone/teleconference termi- 
nals which are connected to digital communication 
channels and which transmit and receive commu- 
nication frames containing video 
telephonlG'teleconferential data, through the con- 



nected digital communication channels and has the 
following characteristics- 

The digital communication channels connect 
the plurality of video tele pfione/tele conferen ce ter- 

5 minals in a ri ng configuration. Each video 
telephone/teleconference terminal comprises gen- 
eration device for generating the video 
telephonic/teleconferential data which is to be sent 
to the other video teiephone/teieconference termi- 

10 nals, relay device for transmitting the communica- 
tion frame received from the video 
teiephone/teieconference terminal at an upper 
stream position of a loop with respect to transfer of 
the communication frames, to the video 

15 telephone/teleconference terminal at a tower stream 
position of the loop so that the communication 
frames may revolve around the loop which is 
formed of the digital communication channels 
which connect the plurality of video 

20 telephone/teleconference terminals to one another, 
transmission devive for entering the generated vid- 
eo telephonic/teleconferential data into the commu- 
nication frame which is to be relayed by the relay 
device, thereby sending the generated video 

25 telephonic/teleconferential data to the other video 
telephone/teleconference terminals which lie on the 
loop, and cancellation device for canceling the vid- 
eo telephonic-'teleconferential data which was en- 
tered into the communication frame by the trans- 

30 mission device of the video 
telephone/teleconference terminal itself before and 
which has revolved around the loop, from within the 
communication frame which is to be relayed by the 
relay device. 

35 According to the multipoint teleconference sys- 

tem of the present invention, each video 
telephone/teleconference terminal causes the com- 
munication frame to revolve around the loop con- 
stituted by the digital communication channels 

40 which connect the plurality of video 
telephone/teleconference terminals to one another. 
In addition, each terminal enters the generated 
video telephonic/teleconferential data into the com- 
munication frame which is to be relayed, thereby 

45 sending the generated data to the other video 
teiephone/teieconference terminals on the loop. Be- 
sides, each terminal cancels the video 
telephonic/teleconferential data transmitted by itself 
before, from within the communication frame hav- 

50 ing revolved around the loop, thereby avoiding the 
• double transmission of the video 
telephonic/teleconferential data and the stocking of 
such unnecessary video telephonic/teleconferential 
data. 

55 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a schematic diagram showing the ar- 
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chitecture of a multipoint teleconference system 
accorcing to an embodiment of the present in- 

venticn; 

Kig. 2 is a block diagram showing the construc- 
tion of a multipoint video 5 
teiephone,'teteconference terminal in the em- 
bodiment of the present invention: 
Figs. 3(a) and 3{b) are explanatory views show- 
ing the operation of the multipoint telecon- 
ference system of the embodiment; w 
Fig. 4 is an explanatory view showing the opera- 
tion of the multipoint teleconference system; 
Fig. 5 is an explanatory view showing the opera- 
tion of the multipoint teleconference system; 
Fig. 8 is an explanatory diagram showing the i5 
iormat of a frame stipulated in the CCITT Rec- 
ommendation H. 221; 

Figs. 7(a) thru 7(d) are diagrams for explaining a 

frame stipulated in the CCITT Recommendation 

H. 261, and examples of use of the frame in the 20 

embodiment of the present invention; 

Figs. S(a) thru 8(c} are diagrams for explaining 

;he relationships in the embodiment between 

GOB'S stipulated in the CCITT Recommendation 

H. 261 and video data; 25 

Fig. 9 is a block diagram showing the first 

example of construction of a video path control- 

ier in the embodiment: 

Fig. 10 is a block diagram showing the construc- 
tion of a video SW/clock change-over control in 30 
the embodiment; 

Fig. 1 1 ts a block diagram showing the construc- 
tion of an audio processor in the embodiment; 
Fig. 12 is a block diagram showing an audio 
mean level discriminator in the embodiment; 35 
Fig. 13 is a block diagram showing the second 
example of construction of the video path con- 
troller in the embodiment; 
Figs. 14(a) and 14(b) are explanatory diagrams 
showing schemes for transmitting control infer- -lo 
mation in the embodiment: 
Figs. 15(a) and 15(b) are explanatory diagrams 
showing schemes for transmitting commands 
and data in the embodiment; 

Fig. 16 is a block diagram showing the construe- 45 
tion of the control system of the chairperson 
terminal in the embodiment; 
Fig. 17 is an explanatory diagram showing an 
example of display of the control information in 
the chairperson terminal; so. 
Fig. 18 is an explanatory diagram showing an- 
other example of display of the control informa- 
tion in the chairperson terminal; 
Fig. 19 Is a block diagram showing the construc- 
tion of ihe control system of the terminal other 55 
than the chairperson terminal, in the embodi- 
ment; 

Fig. 20 is a block diagram showing the first 



example of arrangement of a video decoder and 
peripheral constituents in the embodiment: 
Fig. 21 is a block diagram showing the second 
example of arrangement of the video decoder 
and peripheral constituents in the embodiment: 
Fig. 22 is an explanatory diagram showing a 
frame format which employs an additional chan- 
nel stipulated in the CCITT Recommendation H. 
221 : and 

Fig. 23 is a schematic diagram showing a mul- 
tipoint teleconference system according the sec- 
ond enibodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Now. an embodiment of a multipoint telecon- 
ference system according to the present invention 
will be described. 

First. Fig. 1 illustrates the architecture of the 
multipoint teleconference system in this embodi- 
ment, under the assumptiori that the number of 
ends or. terminals which attend a multipoint 
teleconference is four. 

Referring to the figure, numerals 1. 2, 3 and 4 
indicate the ends, and numeral 5 indicates a digital 
communications network. Here in this embodiment, 
the end A at numeral 1 is a chairperson end which 
takes charge of the functions of the chairperson of 
the multipoint teleconference. Incidentally, in this 
embodiment, an ISDN stipulated in the CCITT Rec- 
ommendations t-Series is assumed as the digital 
communications network 5. Also, for the brevity of 
the description, it is supposed that each of the 
ends is connected with the ISDN by a fundamental 
interface of 2B + 0. 

In this embodiment, the individual ends attend- 
ing the multipoint teleconference are connected in 
the shape of a loop. More specifically, as shown in 
the figure, the end-A 1 is connected to the end-D 4 
and the end-B 2 by separary 8 channels, the end- 
8 2 to the end-A 1 and the end-C 3, the end-C 3 to 
the end-B 2 and end-D 4, and the end-0 4 to the 
end-C 3 and the end-A 1. 

Next;_Fig. 2 illustrates the construction of each 
end in this embodiment. 

Referring to the figure, the end includes a 
video input/output device 200 such as a CRT or 
video camera, a vi deo codec 201 which 
codes/decodes video information, a video path con- 
troiler 202 which multiplexes/ demultiplexes video 
information, an audio input/output device 210 such 
as a loudspeaker- or microphone, an audio codec 
211 which codes/decodes audio information, an 
audio processor 212 which processes audio in- 
formation, a conference controller 220 which per- 
forms the controls of various parts attendant upon 
the multipoint teleconference, a telematic unit 230, 
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a system controller 240 which controls the entire 
snd. an end/network signal controller 250 which 
performs communication controls such as a call 
control between the end and the digital commu- 
nications network 5. an MUX/DMUX 
(multiplexor/demultiplexor) 260 which performs the 
framing process of H. 221 frames to be described 
later, and a network interface unit 270 which takes 

v^iiQi^i^ VI \ttt^ M iu\^o ui a juivci lay VI vviiii iii^ 

network 5. In addition, the system controller 240 is 
furnished with an end/end signal controller which 
processes control data and notification data sent to 
the pertinent end or to be sent to the other ends. 

Among these constituents, the video I/O device 
200, video codec 201, audio I/O device 21 0, audio 
codec 211, telematic unit 230. system controller 
240. end'network signal controller 250. MUX;'DMUX 
260. network interface unit 270 and end.'end signal 
controller have the same details as stipulated in 
CCITT Recommendations H. 320. H. 221. H. 242 
and H. 261. and their operations in ordinary one-to- 
one communications are also as stipulated in the 
above recommendations. In the ensuing descrip- 
tion, therefore, those points of difference from the 
ordinary one-to-one communications which arise in 
the execution of the multipoint teleconference will 
be chiefly elucidated. 

Now, the operation of the multipoint telecon- 
ference system of this embodiment will be outlined. 

Figs. 3(a) and 3(b), Fig. 4 and Fig. 5 illustrate 
the situations of video outputs from the video t/0 
devices 200 of the respective ends and audio out- 
puts from the audio I/O devices 210 as to the case 
where the four ends A, B, C and D are holding the 
multipoint teleconference. 

In an example depicted in Figs. 3(a) and 3(b). 
all the ends present video information transmitted 
from one of the ends, as display outputs. Fig. 3(a) 
shows the state in which the video information 
transmitted from the end B is presented as the 
display outputs by all the ends A. B. C and D. 
Usually, the source end of the video information is 
the end which is used by a speaker in the con- 
ference. This source end is determined in compli- 
ance with an instruction from the chairperson end, 
or it is automatically determined to be the end 
which is transmitting the audio information of the 
highest level. Fig. 3(b) shows the state in which the 
source end of the video information has changed- 
over from the end B to the end C. 

On the other hand, the audio outputs of the 
respective ends do not depend upon the displayed 
video information, but they are produced by mixing 
ail the items of audio information received from the 
other ends attending the conference. Herein, the 
audio information transmitted by the pertinent end 
itself is prevented from being output in the per- 
tinent end, by the use of an echo canceling tech- 



nique. 

More specifically, in the example depicted in 
Figs. 3{a} and 3(b). the audio information items 
transmitted from the ends B, C and 0 are output 

5 by the end A; those transmitted from the ends A. C 
and D are output by the end B; those transmitted 
from the ends A, B and D are output by the end C; 
and those transmitted from the ends A, B and C 
are cutput by Ino snu 

10 In an example depicted in Fig. 4, all the ends 

present two items of video information transmitted 
from two different ends, as display outputs. Fig. 4 
shows the state in which the two video information 
items transmitted from the ends A and D are re- 

75 spectively displayed in the upper and lower parts 
of the display units of alt the ends A, B. C and D. 
Also in this case, the two source ends to transmit 
the display outputs are determined in compliance 
with an instruction from the chairperson end. or 

20 they are automatically determined to be the two 
ends which are transmitting the audio information 
items of the highest level and the second-highest 
level. 

In the case of Fig. 4. as in the foregoing case 

25 of Figs. 3(a) and 3(b). speech is emitted by mixing 
all the items of audio information received from the 
other ends attending the conference, irrespective of 
the output video information items. 

In an :,\ample depicted in Fig. 5. each of the 

30 ends presents the four video information items of 
all the ends attending the teleconference, as a 
display output. Fig. 5 shows the state in which the 
video information items of the ends A. B. C and D 
are respectively displayed on the quartered areas 

35 of the screen of the display unit of each end. 

In the case of Fig. 5, as in the foregoing case 
of Figs. 3(a) and 3(b). speech is emitted by mixing 
all the items of audio information received from the 
other ends attending the conference, irrespective of 

•JO the output video information items. 

In a case where five or more ends or terminals 
have a multipoint teleconference, four source ends 
to transmit display outputs are determined in com- 
pliance with an instruction from the chairperson 

45 end, or they are automatically determined to be the 
four ends in the order in which audio information 
items transmitted therefrom have higher levels. 

Next, there will be explained the communica- 
tion frames which are employed for the commu- 

50 nications among the ends in this embodiment. 

; Here in the embodiment, the frame recom- 
mended in the provisions H. 221 of the CCITT 
(termed "H. 221 frame" in this specification) is 
used for the communication frames among the 

55 ends. 

Fig. 6 illustrates the format of the H. 221 frame. 
Referring to the figure, an FAS at numeral 600 
is used for frame synchronization, a BAS at nu- 
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meral 601 is used for transmitting a comnnancJ. an 
=nd capacity etc.. and a subchannel #8 at numeral 
502 is used ior, for example, the transmission of an 
MLP message. The other area 603 is used for 
transmitting video data, audio data and user data. 

The allotments of the area 603 to the video 
data, audio data and user data are designated by 
the commands and end capacity in the BAS 601, 

The multipoint teleconference system of this 
emtKJdtment will be detailed below. 

Device and expedients for realizing the video 
outputs of the multipoint teleconference system as 
shown in Figs. 3(a) and 3(b). Fig. 4 and Fig. 5 will 
be explained under the assumed condition that the 
four ends or terminals A. B. C and D are connected 
in the loop configuration as shown in Fig. 1. 

First, a transmission frame for the video data of 
each end will be explained. The video data is 
obtained in such a way that video information ac- 
cepted by the video I/O device 200 is coded by, for 
example, the DCT in the video codec 201. Besides, 
the transmission frame of the video data is entered 
into that part of the area 603 of the H. 221 frame 
■•vhich is allotted to the video data- 
Here in the embodiment, a frame conforming 
to the CCITT Recommendation H. 261 
ihereinbelow, termed "H. 261 frame") is used for 
ihe transmission frame of the video data- 
Figs. 7(a) thru 7{d) are diagrams for explaining 
the H. 261 frame. 

Fig. 7(a) illustrates the format of the H. 261 
frame. 

As shown in Fig. 7(a), the H. 261 frame is 
comprised of a header part consisting of a PSC 
701, a TR 702, a PTYPE 703. a PEI 704 and a 
PSPARE 705. and a data part consisting of GOB's 
1-12. The PSC 701 indicates synchronizing data, 
while the TR 702 indicates the sequence No. of the 
circulating system of a packet. 

One picture frame is formed of the video data 
entered into the GOB's 1-12. That is. each of the 
GOB'S 1-12 contains the video data of a picture 
area which is obtained by , dividing one picture 
frame by 12. In this regard. Fig. 8(a) shows the 
relationship between the GOB's 1 - 12 and the 
areas within the picture frame. 

In the case of Figs. 3(a) and 3(b) where the 
video information from one end is output and dis- 
played by all the ends, the source end of the video 
information presents the video information accept- 
ed by the video l/Q device 200, as the display 
output, and it generates the H. 261 frame by enter- 
ing the video data into the GOB's 1-12 and then 
transmits the generated frame. Each of the other 
ends receives the transmitted H. 261 frame and 
presents the video data of the received frame as 
the display output, and it relays and transmits the 
received H. 261 frame to the next destination end. 



When the H. 261 frame transmitted by the source 
end has revolved through the communication chan- 
nels connecting the ends and has returned to the 
source end itself, this source end presents the 
5 video data of the H. 261 frame as the display 
output, and it discards data transmitted by itself 
before. 

Fig. 7(b) illustrates an example of use of the H. 
261 frame in the foregoing case of Fig. 5 where the 

ro four video information items of all the ends attend- 
ing the teleconference are output by each end. In 
this example, the GOB's 1 . 3 and 5 are allotted to 
the end A; those 2. 4 and 6 to (he end B; those 7. 
9 and 11 to the end C; and those 8. 10 and 12 to 

:5 the end D. In this regard. Fig. 8(c) illustrates the 
relationship between the GOB's allotted to the re- 
spective ends and the picture areas of the screen 
of each display unit. 

Now that the end A is the chairperson end. it 

20 codes video information accepted at a reduction 
rate of 1/4 by the video I/O device 200. and it 
generates the H. 261 frame by entering the result- 
ing video data into the GOB's 1. 3 and 5 and then 
transmits the generated frame. The end B receives 

25 the H. 261 frame and presents the video informa- 
tion indicated by the GOB's 1 - 12 of the H. 261 
frame, as the display output. In addition, the end B 
codes video information accepted at the reduction 
rate of 1/4 by the video t/O device 200, and it 

30 enters the new video data of its own into the GOB's 
2. 4 and 6 of the received H. 261 frame and then 
transmits the resulting H. 261 frame to the next 
destination end. 

Likewise to the end B. each of the ends C and 

35 D receives the H. 261 frame and presents the 
video information indicated by the video data of the 
GOB's. as the display output. In addition, it codes 
video information accepted at the reduction rate of 
1'4 by the video I/O device 200, and it enters its 

-«3 own video data into the allotted GOB's of the 
received H. 261 frame and then transmits the re- 
sulting H. 261 frame to the next destination end. 

When the H. 261 frame transmitted by the end 
A has revolved through the communication chan- 
ts nels connecting the ends and has returned to the 
end A itself, this end A presents the video informa- 
tion indicated by the video data of the GOB's of the 
H- 261 frame, as the display output. Besides, the 
end A codes video information accepted at the 

50 reduction rate of 1'4 by the video I/O device 200. it 
enters the new video data of its own into the GOB's 
1, 3 and 5 of the received H- 261 frame, and it 
transmits the H. 261 frame to the end B after 
renewing the header thereof as required. 

55 In the case of Fig. 4 where the two video 

information items transmitted from the two different 
ends are output by each of the ends, the GOB's 
are allotted to the two source ends as illustrated in 
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Fig. 8(b). In this case, the ends other than the 
source ends perform only the operation of display- 
ing the video data items of the received H. 261 
frames and the operation of relaying the H, 261 
frames. Further, in a case where the end A does 
not serve as the source end. it performs only the 
frame generating process, the frame relaying pro- 
cess, and the operation of displaying the video 

Meanwhile, Figs. 7(c) and 7(d) illustrate dif- 
ferent examples of use of the H. 261 frame in the 
foregoing case of Fig. 5 where the four video 
information items of all the ends attending the 
teleconference are output by each of the ends. 

The example depicted in Fig. 7(c) is such that, 
not only the GOB's. but also the header is allotted 
to each end. Herein, each end enters its own video 
data of the video information reduced to i/4. into 
the allotted GOB's of the corresponding H. 261 
frame, and it affixes only the predetermined header 
into the remaining GOB's without entering any 
data, whereupon it transniits the resulting H. 261 
frame. On the other hand, each end presents video 
data items contained in the GOB's allotted to the 
respective ends having the corresponding H. 261 
frames, as the display outputs in the areas cor- 
responding to the GOB'S on the basis of the re- 
ceived H. 261 frames. In addition, when the H, 261 
frame transmitted from each of the ends has re- 
volved through the communication channels con- 
necting the ends around the loop and has returned 
to the end itself, it enters the new video data of its 
own into the allotted GOB's and renews the header 
of the frame as required, whereupon it transmits 
the resulting frame. Owing to such operations, one 
picture frame is comprised of the four H. 261 
frames. 

The example depicted in Fig. 7(d) is such that, 
in the example of Fig. 7fc), each of the ends omits 
the GOB'S containing only the predetermined head- 
er information, from within the H. 261 frame. 

It is controlled by the video path controller 202 
(refer to Fig. 2) of each end to enter the video data 
of the end itself into the allotted GOB's of the 
received H. 261 frame and then relay and transmit 
the resulting frame as stated above. 

The video path controller 202 will be detailed 
below. 

There will be explained the first example of the 
video path controller 202 for treating the H. 261 
frame shown in Fig. 7{b) in which the GOB's are 
successively allotted to the different ends. 

Fig. 9 illustrates the internal construction of the 
vi deo path controller 202. ' 

Also. The video codec 201 and the MUX/DMUX 
260 are illustrated in the figure. 

As shown in the figure, the video codec 201 
includes a video coder 910, a transmission buffer 



911 and a transmission error corrector 9i2 as the 
transmission section of the end, while it includes a 
reception error corrector 932. a reception buffer 
931 and a video decoder 930 as the reception 

5 section. Besides, it includes a video codec control 
920 as the control section of the end. 

In addition, the video path controller 202 is 
provided as the transmission section of the end, 
11 iriCludes a Video o'Vitch SCO, s video switch 

70 Clock change-over control 902 and signal delay 
device 901 . 

The MUX/DMUX 250 is Supplied with the H. 
261 frame of the H. 221 frame received through the 
network interface 270. and it delivers the supplied 

?5 frame to the reception section of the video codec 
201. Besides, the MUX'DMUX 260 generates the 
H. 261 frame and then generates the H. 221 frame 
together with the other data, and it transmits the H. 
221 frame through the network interface 270. 

20 The operation of the reception section of the 

end is the same as in the case of the ordinary one- 
to-one communications. The video codec 201 ana- 
lyzes the H. 26 1 frame delivered from the 
MUX'DMUX 260 and decodes the video data of the 

25 GOB'S 1-12, and it delivers the decoded informa- 
tion to the video I/O device 200. 
y—- The operation of the transmission section of 
the end is classified into three sorts corresponding 
to the cases stated before: the case where the end 

JO enters the video data of its own into all the GOB's 
1-12 and then transmits the resulting GOB's, the 
case where the end transmits the received GOB's 
1-12 as jhey a re, and the case where the end 
enters the video data of its own into the allotted 

35 GOB'S and transnTns the resulting GOB's together 
with the received GOB's from the other source 
ends. 

/ In the case where the video codec 201 has 
been notified by the conference controller 220 to 

•io the effect of entering the video data of the pertinent 
end itself into all the GOB's 1 ~ 12 and transmitting 
the resulting GOB's. the video coder 910 codes the 
video information accepted by the video I/O device 
200 and generates the H. 261 frame which contains 

45 the resulting video data in the GOB's 1 ~ 12 and 
which is stored in the transmission buffer 911. The 
video SW 900 selects the data 903 from the trans- 
mission buffer 91 1 . and delivers the H. 261 frame 
to the MUX/DMUX 260 through the transmission 

so error corrector 912. 

; In the case where the video codec 201 has 
been notified by the conference controller 220 to 
the effect of transmitting the received GOB's i ~ 
12 asjhe^^e. the video SW 900 seiectslfie'data 

55 904 from the reception section and delivers the 
received H. 261 frame to the MUX/DMUX 260 
through the transmission error corrector 912 with- 
ou t anv_c hanqe. 
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In the case where the video codec 201 has 
been noiified by the conference controller 220 to 
the sffect of entering the video data of the pertinent 
end itself into the allotted GOB's and transmitting 
the resulting GOB's together with the received 
GOB's of the other source ends, the video coder 

910 reduces to 1/4 the video information accepted 
by the video I/O device 200 and codes the reduced 
information, and it generates the H. 261 frame 
which contains the resulting video data in the 
GOB's allotted to the pertinent end and which is 
stored in the transmission buffer 911. The allotment 
of the GOB's is also notified by the conference 
controller 220. The video SW 900 delivers the data 
903 from the transmission buffer 911 of the video 
codec 201 and the data 905 from the reception 
section delayed by the signal delay device 901. 
while changing them over. Herein, regarding the 
GOB'S allotteO to the pertinent end, the data 903 
from the transmission buffer 911 of the video 
codec 201 is delivered to the MUX'DfvlUX 260 
through the transmission error corrector 912, and - 
regarding the other GOB's and the header of the H. 
261 frame, the data 905 from the reception section 
is delivered to the MUX'DMUX 260 through the 
transmission error corrector 912. As to the chair- 
person end. however, regarding the GOB's allotted 
to the end itself and the header of the H. 261 
frame, the data 903 from the transmission buffer 

91 1 of the video codec 201 is delivered to the 
MUXDMUX 260 through the transmission error 
corrector 9 12. and regarding the other GOB's. the 
data 905 from the reception section is delivered to 
the MUX/DfvlUX 260 through the transmission error 
corrector 9i2. 

The timing of Such change-over of the video 
SW 900 between the data 903 and the data 905 is 
controlled by the video clock change-over control 
902. Incidentally, the delaying operation of the sig- 
nal delay device 901 is performed in order to 
adjust the input of the data 905 to the video SW 
900 for a time period required for the change-over 
control. 

The change-over control of the video clock 
change-over control 902 for the video SW 900 is as 
detailed below. 

Here in this example, it is assumed that, in 
transmitting the H. 261 frame, each end or terminal 
affixes header information PSC and TR as an end 
flag at a position directly succeeding the allotted 
GOB's. and the video clock change-over control 
902 controls the change-over of the video SW 900 
on the basis of the end flag. The employment of 
the PSC for the end flag is based on the stipulation 
that the value of the PSC shall not develop in the 
video data. 

Besides, in order to distinguish the PSC for the 
end flag from the PSC 70i for the H. 261 header, 



the former is directly followed by a fixed value 
"11111" as the TR. Further, the most significant bit 
of the TR 70? ^5 hitc) in tho hoaHa^ Qf tu.o H. 251 
frame has its value fixed to "0". That is. Nos. i 
5 thru 15 are used as the sequence Nos. of the H. 
261 frames. 

Fig, 10 illustrates the internal construction of 
the video clock change-over control 902. 

Referring to the figure, the change-over control 

70 902 includes a data register 1006. an end flag 
detector 1001. a switch control 1002, and switches 
1005, 1003 and 1004. 

In this example, owing to the video codec 201. 
the H. 261 frame in which the video data obtained 

15 by coding the video information reduced to 1/4 is 
contained in the allotted GOB's is stored in the 
transmission buffer 9n, and the end flag com- 
posed of the PSC and the TR is entered directly 
behind the allotted GOB's. 

20 It is now assumed that the video SW 900 

selects the delayed data 905 from the reception 
section so as to deliver the selected data 905 to 
the transmission error corrector 912. 

On this occasion, the SW 1005 selects the data 

25 904 from the reception section, and the data regis- 
ter 1006 as well as the end flag detector 1001 
monitors the end flag. When the end flag has been 
detected, the SW control 1002 is informed of the 
detection. Then, the SW control 1002 responsively 

30 changes-over the switches 900, 1003, 1004 and 
1005. Thus, read clock pulses are sent. Conse- 
quently, the end or terminal which is not the chair- 
person end reads out the data of the GOB's allot- 
ted to the end itself and the end flag affixed at the 

35 immediately succeeding position as are stored in 
the transmission buffer 911. The end or terminal 
which is the chairperson end reads out the header 
part of the H. 261 frame, the data of the succeed- 
ing GOB'S 1, 3 and 5 allotted to the end itself, and 

•to the end flag affixed at the immediately succeeding 
position as are stored in the transmission buffer 
911. 

The data 903 read out is selected by the video 
SW 900 in lieu of the delayed data 905 from the 

45 reception section, and is delivered to the transmis- 
sion error corrector 912. As to the timing of the 
change-over of the video SW 900, the signal delay 
device 901 has its delay time adjusted so that the 
start position of the data 903 may lie at the start 

50 ; . position of the end flag in the delayed data 905 
from the reception section. As a result, the end flag 
in the delayed data 905 from the reception section 
disappears. 

Owing to the above operation, the SW 1005 
55 selects the data 903 from the transmission buffer 
911. TTierefore. the end flag of the data 903 is 
subsequently monitored by the data register 1006 
and the end flag detector lOOI. When the end flag 
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has been detected, the SW control 1002 is in- 
formed of the detection. Then, the SW control 1002 
responsively changes-over the switches 900, 1003. 
1004 and 1005. Consequently, the initial state is 
resumed in which the delayed data 905 fronn the 
reception section is selected by the video SW 900 
so as to be delivered to the transmission error 
corrector 9l2. 

With the above expedient in wiiich oach end or 
terminal affixes the PSC and the TR as the end 
flag at the position directly succeeding the allotted 
GOB'S and then transmits the H. 261 frame, the 
end flag information items are sometimes entered 
into the position which contains the GOB allotted to 
the nexi end or terminal around the looped com- 
munication channels. By way of example, in the 
end 8. th© end flag information items are some- 
times entered into the position which contains the 
GOB 7 allotted to the end C. However, the data 
contained in the H. 261 frame and transmitted by 
the end C has already revolved through the other 
ends A. B and 0. and it is to be renewed into new 
video data by the end C which ought to receive the 
H. 261 frame subsequently. Accordingly, no 
drawback arises. 

Next, there will be explained the second exam- 
ple of the video path controller 202 for treating the 
H. 261 frame shown in Fig. 7(b) in which the 
GOB'S are successively allotted to the different 
ends or terminals. 

Fig. 11 illustrates the construction of the video 
path controller 202 in the second example. 

Referring to the figure, the video path controller 
202 includes a memory 1100. a read address gen- 
erator 1105 which generates the read address of 
the memory 1100, a write address generator 1104 
which generates the write address of the memory 
1100. a switch control 1103, a register 1102, a 
GOB comparator 1101, a video switch 1106 and a 
buffer for transmission 1 107. 

In Fig. 11. the other parts are the same as in 
Fig. 9 illustrative of the first example. In the video 
codec 201, the video coder 910 reduces to 1/4 the 
video information accepted by the video I/O device 
200 and codes the reduced video information and 
then enters the resulting video data into the GOB's 
allotted to the pertinent end itself, thereby generat- 
ing the H. 261 frame, which is stored in the trans- 
mission buffer 911. 

The data 904 from the reception section is 
stored in the memory 1100 in accordance with the 
output address of the write address generator 
1104. The GOB comparator 1101 monitors the 
GOB of the data 904. Herein, when the No, of the 
monitored GOB indicates the GOB allotted to the 
pertinent end. the operation of writing the data into 
the memory 1101 and the operation of increment- 
ing the address of the write address generator 



1104 are suspended, and the value of the address 
at the time of suspension is stored in the register 
1102. Thereafter, when the GOB No. of the data 
904 has come to indicate any GOB other than the 

5 GOB's allotted to the pertinent end, the operation 
of writing the data into the memory 1101 and the 
operation of incrementing the address of the write 
address generator 1104 are restarted, and the data 
304 is written into the rr.crr.cry 1100. The chsirper- 

jo son end, however, treats even the header part of 
the H. 261 frame similarly to the GOB's allotted to 
the end itself. 

On the other hand, the data stored in the 
memory 1100 is read out in accordance with an 

15 address produced by the read address generator 
1105, and it is sent to the transmission error cor- 
rector 912 through the transmitting buffer 1107 by 
the video SW 1106. The SW control 1103 com- 
pares the address value stored in the register 1 102. 

20 with the value of the output address of the read 
address generator 1105. When the address values 
have agreed, the operation of reading out the data 
from the memory 1100 and the operation of incre- 
menting the address of the read address generator 

25 1105 are suspended, and the video SW 1106 is 
changed-over. Thus, the data 903 of the GOB's 
allotted to the pertinent end is read out of the 
transmission buffer 9l l and is sent to the transmis- 
sion error corrector 912 through the transmitting 

30 buffer 1107. In the chairperson end, however, the 
header part of the H. 261 frame is also read out 
and is sent to the transmission error corrector 912 
together with the data 903 of the allotted GOB's. 
Thereafter, when the operation of reading out the 

35 data from the transmission buffer 911 has finished, 
the operation of incrementing the address of the 
read address generator Ii05 is restarted, the video 
SW 1106 is changed-over. and the operation of 
reading out the data from the memory 1100 and 

40 then sending it to the transmission error corrector 
912 is restarted. 

Incidentally, in a case where the coding opera- 
tion of the video codec 201 has not finished at the 
time of the receipt of the H. 261 frame, dummy 

45 data is entered into the allotted GOB instead of the 
video data. Besides, the end having received the 
dummy data neglects the data. 

Now, there will be described devices and ex- 
pedients for realizing the audio outputs of the mul- 

50 tipoint teleconference system illustrated in Figs. 3- 
;(a) and 3(b). Fig. 4 and Fig. 5. Here, it is assumed 
that the four ends or terminals A, B, C and D are 
connected in the loop configuration as shown in 
Fig. 1. 

55 The audio data is contained in the area 603 of 

the H. 221 frame shown in Fig. 6. 

Herein, the audio data contained in the area 
603 of the H. 221 frame is obtained by mixing the 
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audio data of all the ends which attend the mul- 
sipoint teleconference. Each end receives audio 
data revolving around the looped communication 
channels and cancels audio data transmitted by the 
pertinent end itself before, from the received audio 
data, whereupon the resulting audio data is output. 
In addition, each end mixes audio data to be trans- 
mitted anew, into the aforementioned audio data 
obtained in the way that the audio data transmitted 
by the end itself before is canceled from the re- 
ceived audio data, and it transmits the resulting 
audio data to the next end in the loop. 

It is the audio processor 212 that realizes such 
operations of canceling the audio data transmitted 
by the pertinent end itself and mixing the audio 
data to be transmitted anew. 

The audio processor 212 will be detailed be- 
low. 

Fig. 12 illustrates the internal construction of 
the audio processor 2i2. 

As shown in the figure, the audio processor 
212 includes an echo canceler 1200 which cancels 
the audio data transmitted by the pertinent end 
itself, and a mixer I2i0 which mixes the audio data 
to be transmitted anew. 

The echo canceler 1200 includes an audio loop 
delay control i20i, audio variable delay device 
1202. an audio subtracter 1203, an output control 
1204. a linear — Lt-A converter 1205, a u/A — 
linear converter 1206 and an audio level detector 
1207, On the other hand, the mixer 1210 includes a 
LL.A — linear converter 121 1. an audio adder 1212. 
a linear u/A converter I2i3 and an audio mean 
level discriminator 1214. 

In the echo canceler 1200, the audio loop de- 
lay control 1201 is notified of a delay time taken 
since the transmission of the audio data till the 
return thereof to the pertinent end after having 
revolved around the loop, by the system controller 
240, and it sets the delay time in the audio variable 
delay device 1202. As the delay time, a time pe- 
riod in which a specified transmitted H. 221 frame 
returns- to the pertinent end after its revolution 
around the loop is measured in the MUX/DfwIUX 
260. and it is reported to the system controller 240. 

The ii/A — linear converter 1211 converts 
audio data coded in accordance with the u/A rules 
by the audio codec 211, back into linear data, and 
It sends the linear data to the audio variable delay 
device 1202. The audio variable delay device i202 
delays the audio data delivered from the u/A — 
linear converter 121 1, for the set time period, and it 
delivers the delayed data to the audio subtracter 
1203. 

On the other hand, the MUX/DMUX 260 ex- 
tracts audio data from within the received H. 221 
frame, and it sends the audio data to the u/A — 
linear converter 1206. This U./A — linear converter 



1206 converts the audio data coded in accordance 
with the u.fA rules and delivered from the 
MUX'DMUX 260. back into linear data, and it deliv- 
ers the linear data to the audio subtracter 1203. 

5 The audio subtracter 1203 subtracts the output 

audio data of the audio variable delay device i202 
from that of the uiA — linear converter 1206. Thus, 
the audio data transmitted by the pertinent end 
before is canceled from the received audio data. 

10 The audio data after such cancellation is deliv- 

ered to the linear — u/A converter 1205 through 
the output control 1204 and is coded in accordance 
with the u/A rules by the converter 1205, where- 
upon the coded data is sent to the audio codec 

rs 211. This audio codec 211 decodes the delivered 
audio data, and supplies the decoded data to the 
audio I/O device 210. 

In addition, the audio data, which has been 
obtained in the way that the audio data transmitted 

20 by the pertinent end before is canceled from within 
the received audio data, is sent to the audio adder 
1212 through the output control 1204. The audio 
adder 1212 adds up the audio data sent from the 
output control 1204 and audio data delivered from 

25 the Li/A — linear converter I2ii. Thus, the audio 
data to be transmitted anew is mixed. Therefore, 
the linear — u/A converter 1213 codes the resulting 
audio data in accordance with the a/A rutes and 
sends the a/A-coded data to the IVIUX/DMUX 260. 

30 This fvlUX'DMUX 260 enters the sent audio data 
into the H, 221 frame, and transmits the resulting 
frame to the next end in the loop. 

The audio mean level dtschmtnaior 1214 cal- 
culates the level of the audio data delivered from 

35 the m/A /E linear converter l2n, and sends the 
calculated level to the conference controller 220. 
The discriminated level of the audio data is used 
for the automatic change-over of the video data 
items to be displayed on the basis of the sound 

40 volumes of audio data items as stated before. 

Further, the audio level detector 1207 operates 
when the pertinent end is the chairperson end. This 
detector 1207 notifies the conference controller 220 
of the level of the audio data obtained in the way 

^5 that the audio data transmitted by the pertinent end 
before Is canceled from within the received audio 
data. Besides, the output control 1204 is a device 
. for bringing the output value of the audio data of 
the echo canceler 1200 to zero once in compliance 

50. with an instruction from the conference controller 
220. incidentally, in this embodiment, the audio 
codec 21 1 is supposed to be a ready-made one 
which is interfaced with the data coded in accor- 
dance with the u/A rules. However, in a case where 

55 the audio codec 21 1 is one interfaced with linear 
data, the u/A — linear converter 1211 and the 
linear — u/A converter 1205 are dispensed with. 
Here, the details of the audio mean level dis- 
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criminator 1214 will be explained. 

Fig. 13 illustrates the internal construction of 
the audio'mean level discriminator 1214. 

As shown in the figure, the audio mean level 
discriminator 1214 includes an audio adder 1301. a 5 
write control 1302, a memory 1303, a counter 
1304. a counter value comparator 1305, a reset 
control 1306. a discrimination control 1307 and an 

CIUUIU lOfOI UIO>^ ICILUI , uwu. 

When supplied with the audio data from the w 
U/A — linear converter 1 211 , the audio adder 1 301 
reads out the value of the addition of the audio 
data items up to the last audio data, from the 
memory 1303. and it adds up the read-out value 
and the output audio data of the u/A — linear rs 
converter 1211. Subsequently, it writes the audio 
data after the addition into the memory 1303 
through the write control 1302. The number of 
times of writing into the memory 1303 is counted 
by the counter 1304. 20 

When the number of times of writing into the 
memory 1303 is decided to have reached a pre- 
determined number by the comparator 1305, the 
discrimination control 1307 notifies the audio level 
discriminator 1308 and the reset control 1306 of 25 
the decided situation. Upon the notification, the 
audio level discriminator 1308 reads out the addi- 
tion value of the audio data stored till then, from 
the memory 1303, and it informs the conference 
controller 220 of the read-out value. 30 

On the other hand, the reset control 1306 noti- 
fied of the situation of the writing resets the content 
of the memory 1303 and the count value of the 
counter 1304. 

In the above, the details of the multipoint 35 
teleconference system concerning the video data 
and the audio data have been explained. 

Now. the details of the multipoint telecon- 
ference system will be explained in relation to 
controls required for holding and managing the 40 
multipoint teleconference. 

In this embodiment, it is realized by exchang- 
ing control information among the chairperson end 
and the other ends to construct the multipoint 
teleconference system in which the ends are con- 45 
nected in the loop configuration as described be- 
fore in conjunction with Fig. 1 , to alter the construc- 
tion of the multipoint teleconference system on 
account of any end leaving the multipoint telecon- 
ference, to designate video data to be presented as so 
a display output in each end, and so forth. 

First, the transmission frame of the control in- 
formation will be explained. 

In this embodiment, for the purpose of trans- 
mitting the control information, the area of the MLP 55 
data stipulated in CCITT Recommendation H. 221 
is secured in the subchannel #8 (at numeral 602) of 
the H. 221 frame shown in Fig. 6, and a plurality of 



channels lying in this area are respectively as- 
signed to the different ends. Thus, each end trans- 
mits the control information using the assigned 
channel. 

Each of Figs. I4{a> and 14(b) illustrates the 
channels in the MLP data area. 

The MLP data area has a size of 6.4 kb/s or 4 
kb/s. and it can be secured by a command in the 
area (at ."umera! 501 in Fi"^ 6^ 

Shown in Rg. 14(a) is a case where the MLP 
data area is secured with the size of 6.4 kb/s. In 
this case, the eight channels of a common channel 
and channels Nos. 1 ~ 7 are defined in 8-bit unit in 
the MLP data area as seen from the figure. There- 
fore, the common channel is used for the chairper- 
son end. and the other channels are assigned to 
the other ends by the control information of the 
common channel. 

Shown in Fig. 14(b) is a case where the MLP 
data area is secured with the size of 4 kb/s. In this 
case, the five channels of a common channel and 
channels Nos. 1 - 4 are defined in 8-bit unit in the 
MLP data area as seen from the figure. Therefore, 
the common channel is used for the chairperson 
end, and the other channels are assigned to the 
other ends by the control information of the com- 
mon channel. 

Incidentally, the BAS area may well be em- 
ployed for the transmission of the control informa- 
tion instead of the MLP data area. 

More specifically, the BAS area 601 of the H. 
221 frame shown in Fig. 6 may well be extended 
into the subchannel #8 (at numeral 602) by the 
command of the BAS area 601, so as to use the 
extended part of this area for transmitting the con- 
trot information items of the individual ends. 

The control information to be transmitted by 
each channel consists of a command and data. 

The command and the data to be transmitted 
may well be entered into the channel of the iden- 
tical H. 221 frame as illustrated in Fig. 15(a). Alter- 
natively, they may well be dividedly entered into 
the channels of the successive H. 221 frames as 
illustrated in Fig. 15(b). 

With any of such transmitting schemes, each 
of the ends analyzes the MLP data area or BAS 
area of the received H. 221 frame. It extracts or 
cancels the control information transmitted by the 
pertinent end itself before and contained in the 
channel assigned thereto, and it relays the control 
information items in the other channels of the MLP 
data area or BAS area of the received H. 221 frame 
than the channel assigned to the pertinent end, to 
the next end in the loop without any change. 

In the presence of new control information to 
be transmitted, each end enters the information 
into the channel assigned to the pertinent end 
itself, and it transmits the new control information 
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to the next end in the loop, together with the 
control information items in the other channels of 
the I^LP data area or BAS area of the received H. 
221 frame than the channel assigned to the per- 
tinent end. 

The multipoint teleconference employing the 
control information items which are exchanged 
among the chairperson end and the other ends, 
proceed as detailed below. 

The multipoint teleconference system employ- 
ing the control information items is controlled prin- 
cipally by the system controllers 240 and con- 
ference controllers 220 of the respective ends. 

First, the details of the system controller 240 
and conference controller 220 of the chairperson 
end wilt be explained. 

Fig. 16 illustrates that control processing of the 
multipoint teleconference which is peculiar to the 
end serving as the cnairperson. In this embodi- 
ment, each of the ends is endowed with functions 
for operating as the chairperson end. 

The teleconference which utilizes the looped 
teleconference system shown in Fig. 1, is started 
as follows: 

On this occasion, when the system controller 
240 of the chairperson end A has the other con- 
feree ends B, C and D designated from an un- 
shown keyboard, it controls the end/network con- 
troller 250 so as to establish a call between the end 
A and the end B. Subsequently, a call 
origination/Clearing process 1613 supplies a packet 
composing/sending control process 1627 with a 
command for instructing the called end B to con- 
nect with the end C. The packet 
composing/sending control process 1627 enters 
the supplied command into the common channel to 
generate MLP data or BAS data, which is subjected 
to an MUX interface process 1629 and is thereafter 
delivered to the MUX/'DMUX 260. The MUX/DMUX 
260 generates the H. 22i frame containjng the 
delivered MLP data or BAS data, and the gen- 
erated frame is transmitted to the end 8 through 
the network interface 270. 

When the end B has connected with the end C. 
the system controller 240 of the chairperson end A 
transmits, to the end C, a command for instructing 
the end C to connect with the end D. The com- 
mand is sent through the end B. Thereafter, when 
the end C has connected with the end 0, the 
system controller 240 transmits a command, to the 
end 0. for instructing the end 0 to connect with the 
end A. This command is sent through the ends B 
and C. When the ends A and D have connected, 
the looped system is entirely constructed. 

In this manner, the ends to attend the telecon- 
ference are successively connected by the com- 
mands for instructing the connections with the adja- 
cent ends, whereby the loop is formed up. 



Next, the audio control in the multipoint 
teleconference will be explained. 

The conference controller 220 decides whether 
or not the level reported by the audio level detector 

5 1207 (refer to Fig. 12) of the audio processor 212 
is a mute level for a predetermined time period, in 
other words, whether or not it is below the pre- 
determined level judged to be mute, for the pre- 
determined time period (1621). Herein, subject to 

70 the mute level for the predetermined time period, 
the conference controller 220 instructs the output 
control 1204 of the audio processor 212 to tem- 
porarily bring the audio data to "0", whereby the 
audio output of the echo canceler 1200 is tem- 

15 porarily turned OFF (1620). 

When the audio data level is reset in this 
manner, calculation errors which develop in the 
audio subtracter 1203 and audio adder 1212 of the 
audio processor 212 are restrained from accumu- 

20 lating in the audio data. Incidentally, the accumula- 
tion of the calculation errors arises as noise in the 
case of outputting the audio data. 

Next, the change-over control of video data to 
be displayed in the ends will be explained. 

25 In this embodiment, the automatic mode based 

on the audio data levels of the individual ends or 
the manual mode based on a change-over request 
made by any of the ends can be selected for the 
change-over control of the video data. The selec- 

30 tion is effected with an auto/manual change-over 
switch 1625. 

There will be explained the case where the 
video data items are automatically changed-over on 
the basis of the audio data levels of the ends. 

35 The MUX/'DEVIUX 260 delivers the MLP data or 

BAS data contained in the received H. 221 frame, 
to a packet decomposing/sending control process 
1628 through a DMUX interface process 1630. The 
packet decomposing/sending control process 1628 

40 decodes the delivered MLP data or BAS data, and 
supplies a memory write control 1622 with the data 
items of the audio mean levels sent from the in- 
dividual ends. The memory write control 1622 
writes the data items of the respective ends into a 

45 memory 1623. the levels are compared by a com- 
parison process 1624. and a video path change- 
over instruction process 1626 is notified of the end 
.which exhibits the highest audio data level. Subse- 
quently, the video path change-over instruction pro- 

50; cess 1626 supplies the packet composing/sending 
control process 1627 with a command for turning 
the video data to-be-displayed into the video data 
of the end of the highest audio data level. The 
packet composing/sending control process 1 627 

55 generates MLP data or BAS data containing the 
command in the common channel, and the gen- 
erated data is subjected to the MUX interface pro- 
cess 1629 and is delivered to the MUX/OMUX 260. 
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Then, the MUXDMUX 260 generates an H. 221 
frame containing the delivered MLP data or BAS 
data, so as to transmit the frame to the ends in the 
loop through the network interface 270. 

Next, there will be explained the case where 
the video data items to be presented as the display 
outputs in the ends are changed-over on the basis 
of the change-over request made by any of the 

The IVIUX/DMUX 260 delivers the MLP data or 
BAS data contained in the received H. 221 frame, 
to the packet decomposing/sending control process 
1628 through the DMUX interface process 1630. 
The packet decomposing/ sending control process 
1628 decodes the delivered MLP data or BAS data, 
and supplies a change-over request process 1611 
with a change-over request command if this com- 
mand is contained. When the change-over request 
process 1611 is supplied with the command indica- 
tive of the change-over request, or when an instruc- 
tion for the change-over request is given -from the " 
keyboard, the content of the change-over request 
is delivered to a character superposition process 
1603. Then, the character superposition process 
1603 produces characters to-be-superposed and 
delivers them to a screen display process 1604, 
which presents the content of the change-over re- 
quest in superposition on the display output picture 
of the video I/O device 200 as shown in Fig. 17. 

Subsequently, a request input process 1610 
notifies the video path change-over instruction pro- 
cess 1626 of the end which is transmitting the 
video data requested to be displayed by the 
change-over request. The video path change-over 
instruction process 1626 supplies the packet 
composing/sending control process 1627 with a 
command for turning the video data to-be-dis- 
played into the video data of the aforementioned 
end. The packet composing/sending control pro- 
cess 1627 generates MLP data or BAS data con- 
taining the command in the common channel, and 
the generated data is subjected to the MUX inter- 
face process 1629 and is delivered to the 
MUX/DMUX 280. Then, the MUX/DMUX 260 gen- 
erates an H. 221 frame containing the delivered 
MLP data or BAS data, so as to transmit the frame 
to the ends in the loop through the network inter- 
face 270. 

Next, there will be explained a case where any 
of the ends leaves the teleconference utilizing the 
looped teleconference system shown in Fig. i. in 
the course of this teleconference, or a case where 
a new end attends the teleconference midway. 

The MUX/DMUX 280 delivers the MLP data or 
BAS data contained in the received H. 221 frame, 
to the packet decomposing/sending control process 
1628 through the DMUX interface process 1630. 
The packet decomposing/ sending control process 



1628 decodes the delivered f^LP data or BAS data, 
and supplies a leaving/attendance process 1614 
with a leaving request command if this command is 
contained. When the leaving/attendance process 
5 1614 is supplied with the leaving request com- 
mand, or when an instruction for a leaving request 
or an attendance request is given from the key- 
board, the content of the request is delivered to a 
character superpcsiLion process tG0l. Then, the 
w character superposition process 1601 produces 
characters to-be-superposed and delivers them to 
a screen display process 1602. which presents the 
content of the request in superposition on the dis- 
play output picture of the video I/O device 200 as 
;5 shown in Fig. 18. 

Subsequently, a request input/'sole input pro- 
cess 1612 notifies the call origination/clearing con- 
■ trol process 1613 of the content of the request. The 
call origination/clearing control process 1613 gen- 
20 erates clearing commands and call origination 
commands in dependence on the content of the 
request, and delivers them to the packet 
composing/sending control process 1627. The 
clearing command instructs the two ends which are 
25 each adjoining the end which is leaving in the loop 
to cut off their connections with the leaving end. or 
it instructs the end to attend to disconnect the two 
ends connected in the loop and lying near it. On 
the other hand, the call origination command in- 
30 structs the connection between the ends which 
previously connected with the end having just left, 
or it instructs the formation of a loop which in- 
cludes the end to attend. More specifically, in a 
case where the end C in Fig. i requests to leave 
35 the teleconference, the disconnection between the 
ends C and D is instructed by the clearing com- 
mand, the disconnection between the ends C and 
B is instructed by the clearing command, and the 
connection of the end B with the end D is in- 
•to structed by the call origination command. Further, 
in a case where the end E to attend the telecon- 
ference anew is inserted between the ends B and 
C in Fig. 1 , the disconnection between the ends B 
and C is instructed by the clearing command, the 
45 connection of the end B.with the end E is in- 
structed by the call origination command, and the 
connection of the end E with the end C is in- 
structed by the call origination command after the 
end E has connected with the end B. 
50 The packet composing/sending control process 

;1627 generates MLP data or BAS data in which the 
command delivered from the call 
origination/clearing control process 1613 is con- 
tained in the common channel. The generated data 
55 is subjected to the MUX interface process 1629 
and is delivered to the MUX/DMUX 260. Then, the 
MUX/DMUX 260 generates an H. 221 frame con- 
taining the delivered MLP data or BAS data, so as 
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10 transmit the frame to the ends in the loop 
Through the network interface 270. 

Next, there wii) be explained the conlrot pro- 
cessing of the multipoint teleconference by the end 
which is not the chairperson end. 

Fig. 19 illustrates the control processing of the 
multipoint teleconference by the end other than the 
chairperson end. 

First, let's consider a case where the pertinent 
end has been instructed by the chairperson end to 
connect with or disconnect from any other end. 

The MUX/DMUX 260 delivers the MLP data or 
BAS data contained in the received H. 221 frame, 
to an unshown packet decomposing/sending con- 
trol process through a DMUX interface process 
1909. The packet decomposing/ sending contro! 
process decodes the delivered MLP data or BAS 
data, and supplies the system controller 240 with a 
call origination commsnd or a clearing command if 
this command is contained in the common channel 
(refer to Figs. 14(a) and 14(b))- The system control- 
ler 240 controls the end/network controller 250 so 
as to connect or disconnect the pertinent end with 
or from the end designated by the command. 

Secondly, let's consider a case where the per- 
tinent end has been instaicted by the chairperson 
end to change-over video data to-be-displayed. 

The MUXDMUX 260 delivers the MLP data or 
BAS data contained in the received H. 221 frame, 
to the unshown packet decomposing/sending con- 
trol process through the DMUX interface process 
1909. The packet decomposing/ sending control 
process decodes the delivered MLP data or BAS 
data, and supplies the main conferential control 
process 1907 of the conference controller 220 with 
a command instructive of the change-over of the 
video data to-be-displayed if this command is con- 
tained in the common channel. 

In accordance with the content of the supplied 
command, the main conferential control process 
1907 of the conference controller 220 determines if 
the video data of the pertinent end is to be entered 
into the H. 261 frame which is to be transmitted 
from this end. In case of transmitting the H. 261 
frame which contains the video data of the per- 
tinent end, the main conferential control process 
1907 determines the size of video information to be 
sent by the pertinent end and the GOB's to contain 
the video data. Further, the control process 1907 
notifies the video codec 201 and the video path 
controller 202 of the determined contents. As stat- 
ed before, the video codec 201 and the video path 
controller 202 operate on the basis of the notifica- 
tion. 

Next, there will be explained processing for 
transmitting the audio mean level to the chairper- 
son end. 

When the main conferential control process 



1907 of the conference controller 220 is notified of 
the audio mean level by the audio mean level 
discriminator 1214 of the audio processor 212 as 
stated before, it delivers the data of the level to an 

5 unshown packet composing/ sending control pro- 
cess. The packet composing/sending control pro- 
cess generates MLP data or BAS data containing 
the data in the channel assigned to the pertinent 
end, and the generated data is subjected to an 

10 MUX interface process 1908 and is delivered to the 
MUX/DMUX 260. Then, the MUX/DMUX 260 gen- 
erates an H. 221 frame containing the delivered 
MLP data or BAS data, so as to transmit the frame 
to the chairperson end in the loop through the 

rs network interface 270. 

Next, there will be explained processing by 
which the request for changing-over the video data, 
the request for leaving the teleconference midway 
or a request for transmitting telematic end data is 

20 transmitted to the chairperson end. 

When such a request is input to the pertinent 
end from the keyboard or the like not shown, the 
input accepting process 1903 of the system con- 
troller 240 accepts the request and delivers it to 

25 the main control 1906 thereof. The main control 
1906 generates a command conforming to the de- 
livered request, and delivers the command to the 
main conferential control process 1907. This con- 
trol process 1907 delivers the command to the 

30 packet composing/sending control process not 
shown. The packet composing/sending control pro- 
cess generates MLP data or BAS data containing 
the command in the channel assigned to the per- 
tinent end, and the generated data is subjected lo 

35 the MUX interface process 1908 and is delivered to 
the MUX/DMUX 260. Then, the MUX/DMUX 260 
generates an H. 221 frame containing the delivered 
MLP data or BAS data, so as to transmit the frame 
to the chairperson end in the loop through the 

40 network interface 270. 

Incidentally, a character superposition process 
1905 superposes the command, the data etc. re- 
ceived from the chairperson end, on the display of 
the screen of the video I/O device 200 {a screen 

45 display process 1904) under the control of the 
main control 1906. 

Meanwhile, the above embodiment has men- 
tioned the expedient (Figs. 7(a) - 7(d)) in which the 
video data items transmitted by the four ends are 

50 contained in the H. 281 frame. 

The video codec 201 of each end decodes the 
video data contained in the received H. 261 frame, 
and presents the display output on the video I/O 
device 200. 

55 In this regard, in the case where the video data 

items transmitted by the four ends are contained in 
the H. 261 frame, they are independent of one 
another. Therefore, the video codec 201 can treat 
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the video data items transmitted by the respective 
ends, independently of one another. 

In this embodiment, accordingly, the video 
codec 201 of each end presents the decoded video 
data as the display output when the decoding of 
the video data transmitted by the individual end 
has finished. 

Fig. 20 illustrates the arrangement of the video 
decoder ap.d '^er!'*'h6rH! cGnstituents in th** vi'*"" 
codec 201 . 

Referring to the figure, numeral 2005 indicates 
the decoder, numera! 2001 a decoding memory, 
numerals 2000 and 2007 a display memory of 
double buffer construction, and numeral 2008 a 
reception memory. The video I/O device 200 is 
connected with the buffer of the display memory 
through a switch 2003. When one of the buffers 
2000 and 2007 operates for writing decoded data, 
the other operates for reading out data to be dis- 
played by the video I/O device 200. 

The decoder 2005 reads out received video 
data from the reception memory 2008, and de- 
codes it by reference to the decoded data of the 
last frame stored in the decoding memory 2001. 
The decoded data is written into the decoding 
memory 2001 so as to be referred to in the opera- 
tion of decoding the next frame, and it is also 
written into the buffer 2000 of the display memory 
currently operating tor whting the decoded data. 
When the video data corresponding to 1/4 picture 
area as transmitted by one end has been decoded, 
the buffers 2000 and 2007 are changed-over so as 
to use the former for reading out the data to-be- 
displayed and to use the latter for writing the 
decoded data. 

In this regard, a single memory can be shared 
for the display memory and the decoding memory. 

Fig. 21 illustrates an arrangement in the case 
of using the single memory for both the display 
memory and the decoding memory. 

Referring to the figure, numeral 2105 indicates 
a decoder, numerals 2101 and 2102 a memory of 
double buffer construction which is used as both 
the decoding memory and the display memory, 
and numeral 2008 a reception memory. The video 
I/O device 200 is connected with the 
decoding/display memory through a switch 2104. 
When one of the buffers 2101 and 2102 of the 
decoding/display memory operates as the decod- 
ing memory for reading out reference data and the 
display memory for reading out data to-be-dis- 
played, the other buffer operates as the decoding 
memory for writing decoded data and the display 
memory. 

The decoder 2105 reads out received video 
data from the reception memory 2008. and de- 
codes it by reference to the decoded data of the 
last frame read out of the buffer 2101 which is 



operating as the decoding memory for reading out 
the reference data. In parallel with the operation of 
reading out the reference data from the buffer 
2101, the decoded data of ihe buffer 2101 is read 
5 out for display and is sent to the video I/O device 
200. The data decoded by the decoder 2105 is 
written into the buffer 2102 operating as the decod- 
ing memory for writing the decoded data, so as to 

— 1 w » W4 I III fcl l»J \J^\tfl I ijl l^&W<iJU1l 1^ LI I 

10 frame. When the video data corresponding to 1/4 
picture area as transmitted by one end has tteen 
decoded, the decoded data of an area other than 
the 1/4 area having been processed this time is 
transferred to the buffer 2102 from the buffer 2101 

75 operating as the decoding memory for reading out 
the reference data, and the roles of the buffers 
2101 and 2102 are changed-over. 

Thenceforth, likewise to the above, each time 
the video data corresponding to 1/4 picture area as 

20 transmitted by one end has been decoded, it is 
transferred to the buffer 2102. and the roles of the 
buffers 2iOi and 2102 are changed-over. 

In the foregoing embodiment, the looped mul- 
tipoint teleconference system is constructed in 

35 such a way that the pertinent end is connected with 
each of the adjacent ends by the single B channel 
as illustrated in Fig. i. 

Since, however, the single B channel consists 
of two transfer paths of opposite transmitting direc- 

30 tions. two looped communication channels are ac- 
tually formed in the case of connecting the per- 
tinent end with each of the adjacent ends by Ihe 
single B channel. In the above, there has been 
described the case where only one of the two 

35 looped communication channels is used. In this 
regard, the communication capacity among the 
ends can be increased by simultaneously using the 
two looped communication channels. By way of 
example, video data and audio data can be distrib- 

40 uted to the two looped communication channels in 
such a manner that the former is transmitted by the 
H. 221 frame of one of these communication chan- 
nels, while the latter is transmitted by the H. 221 
frame of the other communication channel. 

45 Moreover, in this case, the H. 221 frame can 

be extended by utilizing an H. 221 frame shown in 
Fig. 22 as employs the additional channel stipu- 
lated in the CCITT Recommendation H. 221. That 
is, one of the two looped communication channels 

50 is used as the "first channel" in the Recommenda- 
;tion H. 221, while the other communication channel 
is used as the "additional channel" in the same. 

The looped multipoint teleconference system 
of the foregoing embodiment is constructed by 

55 connecting the pertinent end with each of the adja- 
cent ends by the single B channel as illustrated in 
Fig. 1. Since, however, the single B channel con- 
sists of the two transfer paths of the opposite 

14 
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tronsmitting directions as stated before, even an 
architecture shown in Fig. 23 in which the pertinent 
end is connected with the succeeding end by the 
single 8 channel can form looped communication 
channels. More specifically, the ends or terminals 1 
and 2 lying at both the extremities of the system 
architecture fold back and transmit H. 221 frames. 
The ends or terminals 3 and 4 not lying at the 
extremities transmit received H. 221 frames to the 
next ends in penetrating fashion in either transmit- 
ting direction. The present invention is similarly 
applicable to the case of forming the looped com- 
munication channels in this manner. 

In the above embodiments, the ISDN stipulated 
in the CCITT Recommendations l-series is as- 
sumed as the digital communications network 5 
shown in Fig. 1. and each end is assumed to be 
connected with the ISDN by the fundamental inter- 
face of 2B + D. 

However, the present invention is not restricted 
to the connection with the ISDN by the fundamen- 
tal interface of 2B + D, but it is similarly applicable 
to a case where each end is connected with the 
ISDN by a first-order group velocity interface. Be- 
sides, when a plurality of B channels within the 
first-order group velocity interface is employed in 
this case, the H. 221 employing the additional 
channel can be used. 

As set forth above, according to the present 
invention, it is possible to provide a multipoint 
teleconference system in which a multipoint 
teleconference can be realized by only conferee 
ends without requiring an MCU. 

Claims 

1. In a multipoint video telephone/teleconference 
system having a plurality of video 
telephone-teleconference terminals which are 
connected to digital communication channels 
and which transmit and receive communication 
frames containing video 

telephonic/teleconferentiai data, through the 
connected digital communication channels: 

a multipoint teleconference system char- 
acterized in: 

that said digital communication channels 
connect said plurality of video 
telephone/teleconference terminals in a ring 
configuration; and 

that said each video 

telephone/teleconference terminal comprises: 

generation means for generating the video 
telephonic/teleconferentiai data which is to be 
sent to the other video 
telephone/teleconference terminals; 

relay means for transmitting the commu- 
nication frame received from the video 



telephone/teleconference terminal at an upper 
stream position of a loop with respect to trans- 
fer of said communication frames, to the video 
telephone/teleconference terminal at a lower 

5 stream position of said loop so that said com- 

munication frames may revolve around said 
loop, said loop being formed of said digital 
communication channels which connect said 
plurality of video telephone/teleconference ter- 

ro minats to one another: 

transmission means for entering the gen- 
erated video telephonic/teleconferentiai data 
into said communication frame which is to be 
relayed by said relay means, thereby sending 

rs said generated video 

telephonic/teleconferentiai data to said other 
video telephone/teleconference terminals which 
lie on said loop: and 

cancellation means for canceling the video 

20 telephonic/teleconferentiai data which was en- 

tered into said communication frame by satd 
transmission means of said video 
tele phone/ teleconference terminal itself before 
and which has revolved around said loop, from 

25 within said communication frame which is to 

be relayed by said relay means. 

2. In a multipoint teleconference system having 
an ISDN which transfers 3 communication 

30 frame around a set channel, and a plurality of 

video telephone/teleconference terminals which 
conform to CCITT Recommendation H. 320 
and which are connected to the ISDN; 

a multipoint teleconference system char- 

35 acterized in: 

that at least one of said plurality of video 
telephone/teleconference terminals comprises: 
channel setting means for setting channels 
between the adjacent video 

40 telephone/teleconference terminals in said 

ISDN so that said plurality of video 
telephone/teleconference terminals may be 
connected in a ring configuration; and 

that sard each video 

45 telephone/teleconference terminal comprises: 

generation means for generating video 
telephonic/teleconferentiai data which is to be 
sent to the other video 
telephone/teleconference terminals; 

so relay means for relaying the communica- 

tion frame received from the video 
telephone/teleconference terminal at an upper 
sueam position of a loop with respect to the 
transfer of said communication frame, to the 

55 video telephone/teleconference terminal' at a 

lower stream position of said loop so that said 
communication frame may revolve arourfb said 
loop, said loop being formed of said plurality of 
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video telephone/teleconference terminals and 
said channels set by said channel setting 
means so as to connect said video 
tele phone/ teleconference terminals: 

transmission means for entering the gen- s 
erated video telephonic/'teleconferential data 
into said communication frame which is to be 
relayed by said relay means, thereby trans- 

• wi II 1^ <tai\j yoi ici aiCU VlUtJU 

telephonicteleconferential data to said other io 
video telephone/teleconference terminals which 
lie on said loop: and 

cancellation means for canceling the video 
telephonic/teleconferential data which was en- 
tered into said communication frame by said is 
transmission means of said video 
telephone/teleconference terminal itself before 
and which has revolved around said loop, from 
within said communication frame which is to 
be relayed by said relay means. 20 

A multipoint teleconference system as defined 
in Claim 2. wherein; 

said communication frame is a frame stip- 
ulated in CCITT Recommendation H. 221 
(hereinbelow. termed "H. 221 frame"), a frame 
stipulated in CCITT Recommendation H. 261 
(hereinbelow, termed "H. 261 frame") is pre- 
pared in said H. 221 frame, and GOB's in- 
cluded in said H. 261 frame are respectively 
allotted to the individual video 
telephone/teleconfeVence terminals; 

said each video telephone/teleconference 
terminal further comprises resumption means 
for resuming video data contained in the plural- 
ity of GOB'S of said H. 261 frame prepared in 
the received H. 221 frame, into a picture of 
one picture frame so as to present a display 
output: 

said cancellation means cancels video 
data which was entered into said H. 261 frame 
by said transmission means of said video 
telephone/teleconference terminal itself before 
and which has revolved around said loop, from 
at least one GOB allotted to said video 
telephone/teleconference terminal itself: and 

said transmission means enters the gen- 
erated video data into at least one GOB allot- 
ted to said video telephone/teleconference ter- 
minal itself, among said GOB's of said H. 261 
frame prepared in said H. 221 frame. 

A multipoint teleconference system as defined 
in Claim 2, wherein: 

said communication frame is a frame stip- 55 
ulated in CCITT Recommendation H. 221 
(hereinbelow, termed "H. 221 frame"), and a 
frame stipulated in CCITT Recommendation H. 



261 (hereinbelow. termed "H. 261 frame") is 
prepared in said H. 221 frame: 

said each video telephone/teleconference 
terminal further comprises audio data resump- 
tion means for resuming audio data into a 
speech so as to emit the speech; 

said generation means generates the video 
telephonideleconferential data including audio 
data: 

said cancellation means cancels an audio 
data component which was entered into said 
H. 261 frame by said transmission means of 
said video telephone-teleconference terminal it- 
self before and which has revolved around said 
loop, from audio data contained in said H. 261 
frame of the received H. 221 frame; 

said audio data resumption means re- 
sumes the audio data with said audio data 
component of said terminal itself canceled by 
said cancellation means, into the speech so as 
to emit'said speech; and 

said transmission means enters new audio 
data into said H. 261 frame of the H. 221 frame 
to be relayed by said relay means, instead of 



S.- A video telephone-teleconference terminal con- 
nectible with a plurality of digital communica- 

; tion channels; comprising: 

generation means for generating video 
telephonic/teleconferential data which is to be 
sent to other video telephone/teleconference 
terminals: 

relay means for receiving a communication 
frame and then relaying the received frame to 
a designated one of said digital communication 



25 said audio data contained in said H. 261 frame 

of said H, 221 frame received by said relay 
means, said new audio data being obtained in 
such a way that said audio data generated by 
said generation means is added to said audio 
30 data with said audio data component of said 

terminal itself canceled by said cancellation 
means. 

5. A multipoint teleconference system as defined 
35 in Claim 3. wherein: 

said plurality of GOB's included in said H. 
261 frame are divided into N (being a natural 
number) groups, which are respectively allot- 
ted to the N video telephone/teleconference 
40 terminals: and 

said resumption means of said each video 
telephone/teleconference terminal resumes the 
video data items contained in said H. 261 
frame, in respective areas of one picture frame 
45 corresponding to the GOB's having contained 

said video data items, so as to present said 
display output. 
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channels; 

transmission means for entering the gen- 
erated video telephonic/teleconferential data 
;"tc ssid comrri'jnic^tion U^'^^- which is to be 
relayed by said relay means; and s 

cancellation means for canceling the video 
telephonic/teleconferential data which was en- 
tered into said communication frame by said 
transmission means of said video 
tele phone/ teleconference temiinal itself before io 
the reception of said communication frame, 
from within said communication frame which is 
to be relayed by said relay means. 

7, A video telephone/teleconference terminal con- is 
nectible with an ISDN; comprising: 

channel setting means for setting a plural- 
ity of' channels between said video 
telephone teleconference terminal itself and a 
plurality of other video 20 
tele phone/ teleconference terminals in said 
ISDN: 

generation means for generating video 
telephonic/teleconferential data which is to be 
sent to the other video 25 
telephone- teleconference terminals: 

relay means for relaying a communication 
frame received from any of the set channels, 
to another of said set channels; 

transmission means for entering the gen- 30 
erated video telephonic/teleconferential data 
into said communication frame which is to be 
relayed by said relay means; and 

cancellation means for canceling the video 
telephonic/teleconferential data which was en- as 
tered into said communication frame by said " 
transmission means of said video 
telephone- teleconference terminal itself before 
the reception of said communication frame, 
from within said communication frame which is JO 
to be relayed by said relay means. 

8. A video telephone/teleconference terminal as 
defined in Claim 7. wherein: 

said communication frame is a frame stip- 45 
ulated in CCITT Recommendation H. 221 
(hereinbelow. termed "H. 221 frame"); 

said video telephone/teleconference termi- 
nal comprises resumption means for resuming 
video data into a picture of one picture frame so 
so as to present a display output, said video . 
data being contained in a plurality of GOB's of 
a frame stipulated in CCITT Recommendation 
H. 261 (hereinbelow, termed "H. 261 frame") 
and prepared in the received H. 221 frame; ss 

said transmission means enters the gen- 
erated video data into at least one GOB allot- 
ted to said video telephone/teleconference ter- 



minal itself, among said plurality of GOB'S of 
said H. 261 frame prepared in said H. 221 
frame; and 

said cancellation means cancels video 
data which was entered into said H. 261 frame 
by said transmission means of said video 
telephone/teleconference terminal itself before 
the reception of said H. 221 frame to be re- 
layed, from at least one GOB allotted to said 
video telephone/teleconference terminal itself. 

9. A video telephone/teleconference terminal as 
defined in Claim 7, wherein: 

said communication frame is a frame stip- 
ulated in CCITT Recommendation H. 221 
(hereinbelow, termed "H. 221 frame"), and a 
frame stipulated in CCITT Recommendation H. 
261 (hereinbelow, termed "H. 261 frame") is 
prepared in said H. 221 frame; 

said video telephone/teleconference termi- 
nal comprises audio data resumption means 
for resuming audio data into a speech so as to 
emit the speech: 

said generation means generates the video 
telephonic/teleconferential data including audio 
data; 

said cancellation means cancels an audio 
data component which was entered into said 
H. 261 frame by said transmission means of 
said video telephone/teleconference terminal it- 
self before the reception of said H. 221 frame, 
from audio data contained in said H. 261 frame 
of the received H. 221 frame; 

said audio data resumption means re- 
sumes the audio data with said audio data 
component of said terminal itself canceled by 
said cancellation means, into the speech so as 
to emit said speech; and 

said transmission means enters new audio 
data into said H. 261 frame of the H. 221 frame 
to be relayed by said relay means, instead of 
said audio data contained in said H. 261 frame 
of said H. 221 frame received by said relay 
rtieans, said new audio data being obtained in 
such a way that said audio data generated by 
said generation means is added to said audio 
data with said audio data component of said 
terminal itself canceled by said cancellation 
means. 
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